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JOINTLY CONSIDERING THE FACTORS OF SAMPLE SIZE (N-ID TO 
N-IODO) AND THE STANDARD DEVIATION OF THE CRITERION MEASURE 
(SD-1 TO SD-25) , A TABLE SHOWS THE DIFFERENCE BETWEEN 
TREATMENTS NEEDED FOR STATISTICAL SIGNIFICANCE AT THE .05 
LEVEL. THUS, IF THE EDUCATIONAL RESEARCHER HAS APPROPRIATE 
INFORMATION ON FAST PERFORMANCE, HE CAN CONSULT THE TABLE TO 
determine the sample size needed to obtain a DIFFERENCE OF A 
GIVEN ANTICIPATED SIZE AND ALSO THE TIME OR LENGTH OF PROJECT 
NECESSARY TO ACHIEVE A DIFFERENCE OF THE DESIRED SIZE. THIS 
ARTICLE WAS PUBLISHED IN THE "ARGR JOURNAL, •' VOLUME 3, NUMBER 
1, NOVEMBER 1966. (LC) 
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Adequate experimental design has long been considered an 
integral part of any research project. All too often, however, edu- 



cational experiraents are inaugurated vjithout consideration of the 



probability of success. This is especially tragic if the initiator's 



professional reputation rests u£>on the success of the experiment. 



Federal support of education now carries with it the con- 



comitant responsibility of research « Experimentation v;ith small 



groups, a natural corollary of emxDhasis upon specific problem areas 



such as underachieving, and gifted children, is further encouraged 



by Title I emphasis upon underprivileged children. Only large cities 



have within their environs considerable numbers of underprivileged 



children. The remaining schools must work v;ith reduced numbers. As 



the number of children involved decreases, the probability of obtain- 



ing significant results decreases. The decrease is esi^ecially marked 



below an N of 100. 



Also to be considered in estimation of i>robable success of 



an experiment is the size of the deviation of the test instrument. 



As this deviation rises, the necessity of showing larger experimental 
control differences also increases. 
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The above two factors should be considered before an experi- 
mental program is actually put into operation. Table 1 below com- 
bines the two factors of sample s5.ze and test deviation. The number 
at the junction of any row and column is the deviation which can 
occur by chance and therefore must be exceeded in experimental re- 
sults in order that the findings may be considered significant. The 
numbers in each cell represent two standard deviations or approxi- 
mately .95 significance. That is, any experimental result exceeding 
the number at the junction of the proper rov; and column will occur 
by chance only five times in a hundred. 

An example of the practical use of the table will aid under- 
standing. Let us hypothesize the dilemma of an administrator who 
wishes to set up a special reading program for low achievers in 
grades four, five, and six. The primary purpose is to raise the 
reading level of the children. A subsequent elevating effect upon 
other areas of curriculum may also accrue. Teachers estimate a total 
of 20 pupils in each grade who would benefit from participation in 
the program. The administrator can visualize immediate costs of 
special materials, special room v^ith furniture, and salary for a 
remedial teacher. These costs may be defrayable through E.S.E.A. 

Title I assistance, with only the finding of a room as the real 
stumbling block. However, a teacher has questioned the project as 
to the possible outcome or value of such a reading program. She 
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maintains that the children v;ho v;ill participate are mentally unable 
to profit from a special program, more especially so, as each has in 
the past received small group instruction in reading from the regular 
teacher without appreciable results. 

What is the administrator to do? Must he base his decision 
entirely upon opinion? A search of past performance of children can 
give valuable information. Average students are expected to gain one 
year in reading ability during ten months of school attendance. 

School records may show slovj readers to be gaining only eight instead 
of ten months. A gain of two months over this eight month gain is 
the objective of the special reading program. 

If the measuring instrument to be used is the reading test 
from the Iov;a Tests of Basic Skills, the standard deviation in terms 
of grade equivalent is about 14 months. Reference to Table I using 
the column headed "14" reveals that if all 60 pupils are used (rov; 60) 
the chance variation (3.61) is greater than the hoped for gain 
(2 months) in reading competence. If the program were extended to 
run an added year, a hoped for gain of four months over the expected 
gain would then be judged as significant. 

Should the experimental design employ control and experi- 
mental groups, the total number of pupils would then be cut in half. 
Reference to Table 1 reveals the chance limit to have increased to 
5.11 months (column 14 and row 30) as a result of reduction of sample 
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size* Thus, the special reading program vjould have to now show a 
2-month gain for 3 years (or 6 months in all) to register significant 



results* 



It is evident, therefore, that Table 1 can be helpful in 



many ways* It can not only be used to determine the probability of 
success of different sample sizes, it can suggest the length of the 
project, and can also aid in determining the exper3.mental design most 
likely to produce significant findings through control of sample size. 
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